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A  PURSUIT  GAME  WITH  INCOMPLETE  INFORMATION 


Introduction 

The  game  analyzed  herein  is  the  simplest  non-trivial  example  of  a  pursuit 
game  lacking  full  information  which  we  could  devise,,  The  existence  of  this 
work  was  mentioned  in  our  report  "Games  of  Pursuit"  (P-257  }.  We  intend  to 
expand  this  paper  into  a  junior  size  treatise-;  the  present  report  will  comprise 
a  chapter. 

The  rules  of  this  " Three-Point  Signal  Game"  will  be  found  in  the  opening 
sentences  of  the  report  proper.  The  pursuer’s  mode  of  gleaning  information 
about  the  evader’s  position  is  intended  to  simulate  the  signals  from  an 
imprecise  position  detector  such  as  radar.  Quintessential  is  the  pursuer’s 
full  utilization  of  his  knowledge:  his  moves  are  governed  by  the  information 
culled  from  the  aggregate  of  all  past  signals.  This  aspect  being  our  quarry, 
the  avoidance  of  undue  complexity  forces  us  to  rather  vapid  modes  of  moving. 

Both  players  hop  from  one  to  another  of  a  line  of  points,  P  being  allowed  the 
greater  span.  Thus  the  essential  deterrent  to  E’s  precipitate  capture  is 
P’s  skipping  over  him.  Such  is  admittedly  unrealistic,  but  on  a  one-dimensional 
course  there  is. hardly  an  alternative. 

As  we  stated  in  P-257,  the  play  decomposes  into  the  direct  and  stat.-i  nnarv 
phases.  The  latter  entails  the  novel  signifiance  and  claims  nearly  all  our 
attention.  A  new  concept  also  emerges  -  of  what  generality  it  is  too  early 
to  say.  This  is  a  closed  set  of  positions  such  that  when  one  is  extant  P 
can  always  so  move  as  either  to  attain  capture  or  maintain  the  position 
within  the  set.  As  capture  is  imminent  at  all  set  positions,  alternatives 
on  P’s  part  appear  strategically  poor.  We  have  assumed  that  they  may  be 
discarded . 
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The  intricacy  of  the  solution  is  surprisingo  If  the  reader  will  glance 
at  the  last  pages  he  will  see  that  it  involves  complex  fractions  reminiscent 
of  some  phases  of  number  theory.  Yet  the  graph  of  the  part  of  the  solution 
of  which  these  are  data  is  nearly  straight.  The  lesson  may  be  that  simplified 
approximations  pay  off  in  games  of  this  kind. 


The  Three-Point  Signal  Game 

The  pursuer  P  and  the  evader  E  each  move  on  a  discrete  lineal  set.  We 
can  describe  a  point  tjy  an  integer  n.  If  P  is  at  n,  he  can  make  any  of  the 
four  moves  which  carry  him  to  n  +  1,  n  +  2.  If  E  is  at  n  he  can  make  any 
of  three  moves  which  carry  him  to  n,  n+1.  The  players  move  in  turn. 

Capture  occurs  when  P  and  E  occupy  the  same  point.  Hie  payoff  is  the  number 
of  moves  of  P  until  capture. 

After  each  of  E1s  moves*  P  is  presented  with  a  set  of  three  consecutive 
points  and  the  information  that  E  is  on  one  of  them  with  equal  probabilities. 
More  precisely:  The  move  following  E’s,  is  a  chance  one  with  the  outcome 
(if  E  occupies  n)  one  of  the  three  signals: 


C_i(n)  =  (n-2,  n-1,  n ) 

cro  (n)  =  (n-1,  n,  n+1  j 
(T1  (n)  =  (n,  n+1,  n+2 ) 


each  with  probability  The  CTj(n)  which  arises  is  told  to  P. 

To  make  the  game  fully  determined  we  should  also  make  the  first  move  a 
chance  one  and  its  outcome  E*s  initial  position.  The  probabilities  for  E*s 
landing  on  the  various  points  are  known  to  P. 


Also  P  is  informed  when  capture  occurs.  Beyond  what  has  been  enumerated, 
P  has  no  information.  On  the  other  hand,  E  has  full  information. 


*  Even  the  knowledge  of  the  signal.  This  is,  of  course,  unrealistic  when  the 
prototype  is  some  imprecise  position  detector  such  as  radar.  But  our  approach 
is  greatly  simplified  by  making  E  privy  to  the  signal. 
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As  usual  with  games  of  incomplete  information,  mixed  strategies  will  be 
entailed.  This  will  mean  the  value  of  the  game  will  actually  be  the ^expected 
value  of  the  number  of  moves  to  capture . 

Let  us  suppose  both  players  employ  optimum  mixed  strategies.  From  his 
knowledge  of  all  past  signals  and  his  knowledge  of  E*s  strategy,  P  can  garner 
more  information  of  E's  position  than  the  bald  amount  supplied  by  the  rules. 

His  optimum  strategy  should  exploit  all  his  knowledge.  likewise  E  knows  the 
extent  of  this  knowledge  and  such  is  a  factor  in  his  decision. 

We  can  pass  at  once  to  the  stationary  phase  of  the  game.  The  two  positions 
diagrammed  in  Figures  1  and  2  will  be  called  the  first  and  the  second.  In 


both  cases,  E  has  the  next  move. 

In  the  first  position  (Fig.  1 ) 

P  knows,  utilizing  all  information  at 
his  disposal,  that  E  occupies  one  of  the 
consecutive  points  on  the  same  side  of 
him  with  probabilities  S  and  1-S. 

(  O^S^l).  In  the  second,  P  knows  that 
E  as  at  one  of  the  one  of  two  points 
adjacent  to  him,  with  probabilities  T  and 
1-T.  (Fig.  2  ),  here  C<T<1,  but  we  can, 
by  symmetry,  suppose  0<T^2° 


These  two  positions  constitute  a  closed  set  in  the  following  sense: 
let  E  follow  the  dictates  of  some  definite  (and  known  to  P  J  mixed  strategy, 
let  a  cycle  of  move  occur,  i„e»,  E  moves,  there  is  a  chance  move  yielding  a 
signal,  P  moves.  Then  we  can  directly  verify  that  P  can  always  so  select 
his  move  that  either:  a  )  capture  occurs  or,  b)  the  first  or  second  position 


*  Really  there  is  a  set  of  first  positions — one  for  each  S 
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occurs  (or  recurs  )  although  in  general  vith  a  new  value  of  S  or  T. 

Now  the  moves  of  P  which  do  not  lead  to  a)  or  b)  appear  to  be  poor  ones. 

We  therefore  make  at  once  the  plausible  assumption  that  they  are  excluded 

# 

from  the  optimal  strategies  of  P  and  consider  them  no  further. 

Should  P  and  E  be  initially  far  apart,  it  is  clear  that  elementary  tactics 

on  the  part  of  P  will  ultimately  bring  about  a  first  or  second  position 
.  ** 

(or  capture J.  Thus  we  are  justified  in  speaking  of  the  present  phase  of 
the  game  as  the  stationary  one. 

What  we  are  doing  may  be  regarded  as  starting  anew  with  a  fresh  class  of 
games.  For  example,  in  the  first  position  case,  the  first  move  is  a  chance 
one  of  probability  S  (S  known  to  both  players).  E  moves  next,  etc. 

We  wish  to  calculate  0 (S  )  and  jp'il ),  the  expected  number  of  moves  to 
capture  for  the  first  and  second  positions*  A  simple  example  from  classic 
probability  theory  will  clarify  our  technique.  Suppose  a  coin  is  tossed 
until  it  lands  heads.  What  is  the  expected  number  of  tossings?  Calling  it 
e,  the  first  toss  has  two  outcomes,  each  with  probability  If  heads, 
there  is  one  toss;  if  tailSjWe  revert  to  the  initial  situation  and  the  expected 
number  is  1  +  e. 

Thus 

e  =  J  •  1  +  J  (1  +  e  ), 

an  equation  which  may  be  solved  to  obtain  e. 

Let  us  turn  to  the  first  position*  The  data  furnished  P  is  a  value  of 
S  and  one  of  the  five  cTj  shown  in  Fig.  1.  He  has  the  choice  of  moving  one 
or  two  points  to  the  righto  We  thus  can  tabulate  his  strategy : 

*  The  analysis  of  most  reasonably  complex  games  is  encumbered  by  a  profusion  of 
manifestly  absurd  strategies.  If  they  be  discarded  early,  subsequent  develop¬ 
ment  becomes  greatly  streamlined. 

**  This  claim  will  be  definitely  substantiated  later. 
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The  upper  indices  are  the  number  of  moves;  those  on  the  left, the  j  of  the 
q-j  received.  The  entries  are  probabilities c  We  have  Buppreseed  certain 
manifestly  foolish  choices.  For  example,  if  P  receives  (J^,  he  knows  E*s 
position  and  captures  at  once  by  moving  one  space,  likewise  two  spaces  is 
clearly  the  move  in  the  event  of  CT^  or  cTj.  If  (T^  is  received  he  jumps  one 
space  with  probability  (S  )  (0  ^  P2  —  1  )f  etc. 

We  could  form  a  similar  table  of  E!s  strategies.  But,  instead,  we  will 
combine  Efs  move  with  the  chance  move  which  precedes  it  (i.e„,  the  move 
which  locates  E  with  probabilities  S  and  1-S  )  and  deal  only  with  the  resultant 
probabilities.  In  Fig.  1,  suppose  P  is  at  nj  then  after  E's  move,  E  will 
be  at  either  n  +  1,  n  +  2,  or  n  +  3.  let  the  respective  probabilities,  as 
a  result  of  the  two  moves  combined^ of  E's  being  at  these  points  be  A(S  ), 

B(S  C(S  ).  What  control  does  E  enjoy  over  these  numbers?  Clearly  he 
cannot  get  to  n  +  3  unless  he  started  from  n  +  2;  thus  C(s)<Cs.  We  shall 
show  this  is  the  only  restriction. 

lemma  1.  let  S,  A,  B,  C  be  numbers  in  £o,lJ  with  A  +  B  +  C  =  1  and 
C  >0.  Then  if  the  chance  move  suffers  probability  value  S,  E  can 
select  his  strategy  so  that  the  net  probabilities  of  his  landing  on  the 
three  points  to  the  right  of  E  are  A,  B,  C. 

Proof.  If  the  first  move  puts  E  at  n  +  j  ( j  =  1,2  )  let  the  probabilities 
of  his  moving  -1,  0,  1  points  to  the  right  be  Q.  -,  Q  ,  Q.  . 


C learly 
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_2  =  0.  We  have  to  show  that  the  Q ^  can  be  chosen  to  satisfy 

^  -  s  ^10  +  s  Vi  =  A 

(1  -  S  )  Qu  +  S  Q^O  =  B 

5  921 


Q10  +  Q11 


92,-1  +  Q20  +  921 


=  C 
=  1 

=  1 


0  <  Q  .  <  1 

Jk 

If  S  =  1,  a  solution  is  evident.  If  S  <1  let  X  be  any  number  satisfying 

0  <  X  <  1 


l.-.B,  -  S  <  ^  <r  ..A 
1  -.s  -  K  1  -  s* 


(<) 


This  is  possible  as  ®  g  ®  ^  1,  and  ~^1^^  =  l^s  * 


Putting 


^2,-1 

^20 

921 


=  X 

=  1-X 

=  hzd-sJh 

s 

_  B  -  .(1-SXl-X) 

s 

_  JL 


>  (2) 


we  can  verify  that  all  of  our  conditions  are  satisfied. 

Remark :  We  shall  solve  our  modified  problem  and  A(S  ),  B(s  ),  C  (s  ),  shall  be 
a  part  of  our  answer.  If  the  solutions  in  the  original  terms  is  wanted, 
the  partial  strategies  of  E  (i.e.,  the  )  may  be  ascertained  from  (2  ) 
with  X  taken  as  any  function  of  S  satisfying  (l ). 
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We  proceed  as  follows  with  the  first  positionc  We  list  all  possible 
outcomes  after  a  cycle  of  moves,  multiply  them  by  their  probabilities  and 
by  their  subsequent  state  (as  in  the  coin  tossing  problem  ),and  add. 

For  example:  suppose  E,  after  moving,  is  at  n  +  2,  P  receives  the  signal^, 
and  P  moves  one  space.  The  probability  of  all  this  happening  is 


B(S)  •  j  *  P3(S). 

f;  (s  ) 

A  first  position  results.  But  the  value  of  S  is  now  g(sjl  +  cTs~) 
this  possibility  will  contribute  the  term 


Thus 


\  b(s;  p3(s; 


of _ cfel  ) 

t^B(S  J  +  c  (S  ;/ 


We  write  the  full  expression,  omitting  the  arguments  S  on  the  right  side 
for  brevity: 


8  (s )  =  j 

+  B 


+  C 


aQl  +  P2'1  +(i-f2Xi+£(o})  +  p3-i  +(i-P3Xi+?'(^5ij] 

+  (i-p2J*i  +  p3  +  (i-p3)»i  +  ij 

p3d+£(^))  ♦  (1-P3X1  +$&)) +  2  a  *8(0 n 


=  1  +  (a+2c  )  *  £(o ;  +  T  ;  +  p2  [b  -  a 


(b+cJ8(^)  . 


+  p„ 


(3) 


Let  us  call  the  right  side  of  (3  ),  ?.  If,  in  5*  the  A,B,C,P2,P3  are 
considered  as  prescribed  functions  of  S,  (3  J  concerns  itself  with  expressing 
the  expected  number  of  moves  to  capture  in  terms  of  them.  However,  we  are 
after  optimum  strategies. 
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Let  us  call  the  right  side  of  (3  )  tP(A,B,C,P2,P2,  writing  (3  J 


L 


we  considered  A, as  given  functions  of  S.  Then  (3  )  is  a  functional 
equation  satisfied  by  the  £  and  which  arise  when  these  definite  strategies 
are  employed.  (Of  course,  there  is  a  similar  equation  for  the  second  position. 
We  will  exhibit  it  shortly.  ) 

But  our  goal  is  optimal  play.  Let  Q  and  y  denote  the  outcomes  when 
both  players  employ  optimal  strategies.  Think>for  the  moment,  of  S  as  fixed. 
Then  (3  )  is  descriptive  of  a  transition  from  one  fixed  position  to  a  number 
of  possible  others.  Suppose  that  for  all  these  others  the  optimal  values 
have  already  been  ascertained.  We  think  of  A, as  a  set  of  numbers  and^ 
if  these  have  been  chosen,  we  have  for  the  original  position, 

£(S)  « 

We  now  apply  the  tenet  of  transition.  We  obtain 

<f(S)  =  max  min  5>(A,  . .  .,P  j.  (4) 

A,B,C  P2,P  i  L  >  J 

c<s  p 


This  and  a  later  one  like  it  for  the  second  position,  are  the  basic 
equations  with  which  we  work.  They  are  functional  equations  for  Q  and  j 
and  we  will  see  later  that  they  have  a  unique  solution.  As  we  will  hence¬ 
forth  be  concerned  only  with  optimal  play,  we  will  drop  the  asterisks 
from  (5*  and  A  (S  },...,  P^  (S  )  will  denote  the  minimizing  or  maximizing 

values  of  A, ...,P^  in  (/+)  and  describe  the  optimal  strategies. 

We  can  evaluate  £ (0 )  at  once.  This  is  because  the  first  position 
with  S  =  0  is  closed  in  itself.  We  observe  the  first  position  with  S  =  0 
is  the  same  as  the  second  with  T  =  0  or  1. 

Theorem  1.  £(0)  =  3/2,  A(0  )  =  B(0  )  =  J  ,  P2(0  )  +  (0  )  =  1. 

*  The  last  two  arguments  are  an  abbreviation.  They  symbolize  all  the <5  and 
expressions  of  the  right  member  of  (3  ),  In  our  later  work,  we  shall  omit 
writing  them. 
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•Rpttib-pV  •  It  is  evident  that  C  (C  )  must  be  0  here.  Furthermore  the  signals 
O'  and  0~  convey  exactly  the  same  information;  thus  a  strategy  requires 
only  the  value  of  the  arithmetic  mean  of  and  here  given  by 

J  (p2(o  )  *  p3(c)=  §. 

Proofs  As  C  =  0,  we  get  from  (3  )  and  (4 ) 


£  ( 0  )  -  max  min 


1  +  \  A  £ (0  )  +  P2  -^^(B-A  )  +  P^  (B-A  ) 


A,B  P?  P,  L 
A+B=l 

=  1  +  <?  (0 


3  3 


where 


of"  =  max  min 


A  >  B  ?2 1 L 


A+B=l 


?  (P?+P  )  1  ' 

f  A  +  — ^ (B-Aj  =  max  min  e(A,B,P2>P3) 


<  max  0  (A,  Bf  j,  5  )  =  max  j  A  +  ^ 


A,B 


=  max 


2'  2 

A+E  _  1 


A,B 

A+B=l 


3  * 


P2’P3 


^  >  min  ©(J,  J,  P2,  P3  )  =  min 
*2*3 

Therefore  <f*  (0  J  =  1  £(0) 

£(0J  =  | 


(5) 


How  for  the  second  positionl  The  following  are  the  strategy  tables: 


P: 
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&2  or  cr3 

°4 

cr5  or  cr6 


i-p2  (t  )  P2(T)  0 


0 


0  0 


0 


P4(T) 


0 


l-pc(T) 


(We  note  that  0"2  and  (T^, 

as  well  as  <J ^  and  convey 

precisely  the  same  information 
to  P  and  are  thus  equi valent  ) 


0 

1-9-lCT  ) 

qx(T) 

0 

(The  left  index  is  the  position 
of  E  if  P  is  at  n ) 


Now  proceeding  as  before :  (we  use  |  in  place  of  8  (0  ) ) 

^  (T  )  =  j  £  (1-T  fe^Jl+2  (  (1-P2  )  +  P2  (l+£  J  )}  +  (1"T  ^1"q-l  )  [2  (  (1“P2  ^(1+2  ^  +P2  ^ 

♦  d-P4j  +  p4  d+£d))]  +  Td-qj)  [d-p4Xi+<?d)) +  p4  +  2  (p5+(1-p5^ 

d*f  )j] +  [z(p5d  ) +  d-P5 )) +  ij  | 

=  1  +  (l-T )  [l-q_1-p2+2p2Q_iJ  +  T  |l-q1-p5+2p5  Q-^j 
+  i  £(l  j  [?  +  P4(1-2T)  -q1  T(l-P4)  -q.^U-T 

=  0  (T,  9_i»91»P2»P4*P5^  ^ 


Or,  for  the  optimal  case: 

t  (T)  =  max  min 


'■£  (T  )  =  max  min  0. 

1-1, *i  P2-P4-P5 
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Iswm.z 


If  ^  1  and  L  =  1  -  p  -  q  +  2pq 


then 


0  <  L  <  1. 


Proof : 


L  =  2(p  -  J)(q  -  +  \ 

=  2PQ*1 

with 

M  2 

"2  2*2  +  2-L-2'  2’ 2 

+  2ml- 

lssm-1  ^(T)<2  + 

Proof:  We  may  suppose  T  ^  In  the  coefficient  of  <£?  (l  J  is 


<  *  |t  +  p4(l-2T)J  <  ^  T  +  (1-2 T )  =  ^  (l-T)S 


<J. 


By  Lemma  2,  applied  to  the  coefficients  of  T  and  1  —  T,  all  the  other 
terms  of  $ 

<  1  +  (1-T  )  +  T  =  2. 

lew  4  6*  (1 )  ^  3 

Proof :  From  (3  )  and  (4  ) 

6*(l)  <  max  <P(A,B,C,0,0) 

A,B,C 

=  max  fl+2  (A+2C)  +  2  (A  +  C)  ^  (^T  ) 

A j  B  j C  L_  _ 

Jl  »U  +  0  J  i  *  2  J  2_ 

=  max  0.  (A,C  J 
A,B,C 

By  Lemma  3>  for  every  A  and  C 

61(A,C  )  <1  +  (A  +  C  )  (|  +  +  J  J  +  2 

<i  +  (|+l  +  -^Jj+2*|  +  ^ 


2  3 
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Thus  <S  (1 )  <  |  + 

f  £(1)<  f 

<?(l)  <  3. 
Theorem  2.  If  T  <  2 


^(T) 


-  2  +  <f..(U  , 

"2  6  1 


=  2  +  -1 
2  12 


T 


and  the  optimum  strategies  are  given  by: 


If  Tsf 

qj  =  q-1  =  2  ' 

if  T 

p2  =  2'  P4  '  °>  P5  “  2 


_  u  . 
"  12  ’ 


if 


_  IZ 
“  24 


p4  “  2  * 


Remark  1„  The  parts  of  the  above  statement  in  square  brackets  are  not 
intended  as  part  of  the  theorem.  Our  next  result  will  show  that  £ (1 )  -  2 5 
then  the  brackets  follow  at  once. 

Remark  2.  Lemma  4  assures  us  that  (in  both  cases  )  p^  <  1. 

Remark  R .  If  T  >  2  we  utilize  evident  symmetries  to  find  ^  (T  )  and  the 
strategies. 
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Proof : 


1)  T  <: 


p(Tj  ^  min  0(T,  P2,  P,,  Pc  } 

p2>p4,p5 

=  mln<  1  +  (l-T  )  2  +  T  2  +  3  ^  (l  )  \z  +  p4(  2  “  T) 


The  minimum  occurs  when  p.  =  0;  therefore 

4 


>f  ecu 


2 )  T<?  « 

i  ♦  j£nJ 

A  3 

?(T)  ^  max  JZ!  (T,  q^q,,  2»  °»  - 2 - ^ 

ql,q-l 

r  i  * 

=  max  ^1  +  (l-T  )  2  +  T  1-q^-  —  2  (1  -  2q^  ) 


+  i  €(1)  T  (1  -  qxJ  1 


_  ___.3  +  _£lU  T  l  -  3  +  jf  (U  T 

-  max  ^  2  +  6  T[  “2  6  T* 


3  )  T  =  2»  The  result  of  l)  holds  for  any  p2,  p^»  P^. 
In  place  of  2  }  ) 


oj^max  $(  q  ,,  q 


1  +  1  + 


q_l»ql 


2»  4_r  Hi*  2  »  2» 


) 


1*1 

,  1 

=  max  * 

1  +  2 

!-q_l  -  2  ^1-2q-l ) 

L  r  n  n  “l"l  J 

+  2 

+  lev 

=  3  +  j£OJ.  1 

2  6  2 


1  - 


_£oj 


i-qi- 


2  2 


(l"2q1 J 
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Theorem  3.  <£*  (1  )  =  ^  and  the  optimal  strategies,  when  S  =  1,  are 


A  =  B  =  0,  C  =  1,  P2  =  =  0. 


Prppf. 


1)  £(l)>min  Jl  ♦  1  +  ^(1)  +  P2  |  [o]  +  P3  -  *  j£(l) 


P2,P3 

As  <?(l)  =f(0)  =  | 

£  (l  J>  min  - 


>  * 


Suppose  now  £(l)  2*  The  minimizing  value  of  P^  is  1  and  we  have 

£(i;>f  +  j£u)-§ 


§  <fCO  >  2,  <f(lj>3, 


contradiction.  Thus  £(l)>^  and  the  minimizing  value  of  P^  is  C. 
i  *  (A*2C  )  \  *  ) 


2)  <?(1)<  max 

A,B,C  L 


=  max  jB(A,B,C  ). 
J  A,B,C  ’ 


Ve 


note  p(0,0,l )  -  1  +  1  +  ^(1 )  = 


(8J 


Suppose  that  {3  is  maximized  by  a  set  of  values  for  which 

A*C  ^2° 


Then  C  ^  2  (A-*C  J  or  C  ^  A.  From  C<1-A<C1-C  we  infer  C  <C  2* 
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For  such  A  and  C  we  can  apply  Theorem  2  and  we  find 
=  1  ♦  i  A  +  C  +  hf) 


p 


2  “  '  w  '  3  v  2  '  6  A+C 

=  1  +  A  +  C  (  f  +  )  <  1  +  (1-C  )  +  C  (  f  +  ) 


=  2  +  C  ( 


i+4^)<2+^  = 


) 


3  * 


In  virtue  of  (8  ),  a  maximum  is  not  attained.  Thus  when  it  is  attained 


A-»C  2 

i  +  •  711X18 

psl+^A+C  +  ^  +  "^18^  A 
=  1  +  (1  +  ^  a  +  |  C 

Now  1  +  ■^■g^lsl  +  ^  <'2*  Theref°re  "the  maximum  occurs  when  C  =  1, 


A  =  0  and  finally 

£(U<:i  *§=§  . 

Now  that  we  know  we  return  to  (3  )  and  (4 )  and  put  Is  in  a  suitable 
form  for  computation. 

<f(s)  =  max  min  fCA^B^CjPpjP^  J 
A,B,C  P2,P,  J 

c<:s  J 


U) 
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wit  h 


tp  = 


1  +  —  A  C  + 

2  3 


2  JL  air  (A.»C.J 

_2  12  A  +  C 


+ 


+  P, 


+  P(-£- ) 

3  'B+C  ' 


=  1+A+2C+|5  min  (A,C  )  +  P£  2  “  A~| 


+  P. 


-  ^  ^  min  (A,C  )  +  <£(^  ) 


(9) 


We  will  write  (4)  in  the  form 

£(S)  =  max  p(C  ) 
CSS 


(10; 


where 

n(c)  =  max  min  9. 

A,B  P2»P^ 

We  can  eliminate  B  by  replacing  it  by  1  -  C  -  A.  Further  in  *?  we  will 
replace  the  <5*  term  by  its  pi  expression  utilizing  (10  J.  Then 


|i(C)  =  1  +  3/2C  +  max  6(a) 

A 

0<A<1-C 


(11) 


where 


6(A )  =  min 


in  i  A  +  ^  min  (A,C  )  +  p2 
,p3  ^ 


+  P„ 


-  ^  min  (A,C  )  +  ^  max  p(r ) 

r<—£— 

~  1-A 


t 


(12  ) 


*  It  will  turn  out  that  p  is  increasing.  Thus  the  last  factor  of  the  last 
term  can  be  replaced  by  p  )  and  (10  J,by  E(S  )  =  p(S  ).  But  we  do  not  know 
this  a  priori.  We  regard  C  as  fixed  in  0  and  prefer  not  to  write  it  0(A,C% 
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In  (12  )  we  shall  designate  the  coefficient  of  by  X,.  We  shall  aim  at  p 
rather  than  E.  Our  precedure  will  ascertain  successively  the  constants 
C^, ..o,C^  wi th 

0  <  c5  ...  Cx  <Ci« 

We  shall  first  find  p  in  the  interval  M-  The  values  there  will  be 

precisely  those  needed  to  know  the  p  term  in  X  when  p  is  calculated  for 

C  in  the  interval  [c2,  c£.  We  proceed  thus.  When  we  know  the  values  of 

p  in  one  interval,  these  values  will  suffice  to  determine  X  in  the  next 

so  that  p  can  be  found  there 0  The  C  .  come  to  light  successively  with  the 

J 

intervals. 

A  graphical  diagram  will  facilitate  matters. 


In  the  C, A- plane  we  are  concerned  only 
with  the  region 

0  <^C  <  1 
0^  A  ^  1  -  C 

which  is  the  triangle  sketched  in  Fig.  3. 
Because  min(A,C  )  appears  in  (12  )  we 
divide  the  triangle  by  the  line  where 
A  st  C.  We  also  draw  the  line 


where  the  coefficient  of  P2  changes  sign. 
Below  this  lire  this  coefficient  is  positive 
and  so  the  minimizing  P2  is  0;  above  the 
line  it  is  1. 


Very  important  on  the  diagram  is  the  curve  where  X  =  0.  We  do  not  know 
it  yet,  of  course,  but  it  is  helpful  to  mark  it  tentatively;  it  is  indicated 
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in  Figo  3  as  the  dashed  line.  We  shall  discover  subsequently  that  X>  0 

below  it  and  X  <0  above.  Below  it,  then  the  minimizing  =  0,  and  we 

* 

can  calculate  6  there. 

lemma  5.  In  the  regions  I,  II,  III  of  Fig.  3,  ©  is  an  increasing  function 
of  A.  In  IV,  ©  is  constant  and  equals 

2  “  ^2  “  ^  ^  C  *  (13  ) 

Ergpf : 

In  I,  ©  =  A(1  + 

In  II,  6  =  A  +  ^  C  (14  > 

In  III,  e=A+^A+^-A  =  3|A+1f£  (15) 

In  IV,  ©  =  A+j^C+^-A 

Thus  we  may  expect  to  find  no  maximizing  values  of  6  below  the  dashed  line 
(or  strictly  when  X>  0  )  except  in  TV. 

let  &(C  )  be  such  that  when  it  replace  A  in  X,  X  vanishes;  in  other 
words  A  s=  a(C  )  is  the  equation  of  the  dashed  curve. 

Theorem  A„  There  is  a  number  such  that 


and  when  <T  C  ^  1; 

X  >  0  for  all  A  in  Jo,  1-c] 

^(c)  * 

*  If  the  reader  objects  to  working  subject  to  an  unproved  result,  he  can 
recast  lemma  5  in  another  form  by  adding  the  hypothesis  that  P^X  =  0. 
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The  optimizing  values  are 


P2  =  1,  P3  =  0 
A  =  1  -  Co 


Proof:  Let  M  denote  the  last  term  of  (11 ),  i.e., 


M  =  max  ©  =  max  min 
A  A 


Let  C  >  ~ . 


1)  In  the  braces  above  put  Pg  =  1,  P^  =  0« 


M  <  max  |  ^  min  (A,C  ) 


Now  A^l  -  C<1  “  2  =  2^  an<^  80 


M  <  max  <  A  r  * 


The  maximizing  A  is  1  -  C ; 

M  <£  (1-C  )  (J  +  jl  ). 

2  )  We  note,  that  if  A  =  1  -  C, 


max  p.  (r )  =  max  p,  (r  )  =  £*(l )  = 


r<l 


Taking  A  as  1  -  C  (then,  as  above,  A<C  )  we  find 


(16) 
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M  “  P^?3[(1+^H1'<5J“P2  M  +P3["2-36  (l^  +  3  f]j' 

The  non— negativity  of  the  latter  bracket  (i0e« ,  X )  is  in  turn  equivalent  to 

-2  -fb  l  C£0 

-23  *  2%  >  o 

36  — u 

c>H-  Ojj 

When  this  inequality  holds,  the  minimizing  an<^  Pj  are  1  and  0  and  so 

M  >  (J  +  ||)  Cl-C  ). 

3)  |i  =  1  ♦  |  C  +  M  =  l  +  |c  +  (J  +  ^)(l-Cj. 


Now  for 


We  now  embark  on  our  interval-by-interval  calculation,,  As  the  full 
process  is  tedious  and  repititious  we  shall  abandon  a  rigid  format,  compute 
one  interval  in  full  as  a  sample,  make  a  few  remarks,  and  state  the  result. 

f  We  first  suppose  2  <C  so  that  we  may  retain 

A  <C.  This  turns  out  true  for  the  maximizing  A  on  the  whole  interval. 

We  need  not  reinvestigate  our  a(C  j  under  the  premise  A  >  C  as  the  term 

min  (A,C  )  is  too  small  to  cause  a  sign  change. 


[C2»Cl]! 


The  interval 


C2,C^j 


is  selected  so  that  the  term  max  p(r)  in  X  can 

r  <-£— 

r^l-A 


be  evaluated  from  the  p.  values  of 
(see  (12  )) 


Here  [i  is  increasing  and  X  becomes 
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AiC.  _  JL  .  .  1=4 
2  36  3 


2  +  JL  +  (j  _  _2  j 

2  +  36  u  36 '  1— A 


The  coefficient  of  A  is 

-1-12 

1  54 

Comparing  with  (15  )  and  referring  to  Fig.  3»  we  see  that  ©(A  )  is  decreasing 
when  we  are  above  the  dotted  line.  This  means  that  the  maximizing  A  is  a(C  ). 
We  suppose  that  in 


^2*^1  *  )  *ias  the  ^orm 


a  -  bC 


with  a  and  b  constants.  The  range  of  validity  is  to  be  those  C  for  which 

ci-  I^c"iSl 


or 


r  <  "  -  w  ■ 

L1  —  1-a+bC 


~<1 


or 


C1(l"a  ) 


r  _  _  C  r  <r  2-a  _  r  * 

C2  ~  1-b  C1  —  0  —  1-b  “  C1 


(17) 


(this  line  numerically  defining  C£  and  )« 


As  a(C  )  annulls  X,  we  must  have 


_  SLJ£L  _  a  +  l=fl 
2  36  “  3 


2  +  2L  +  (1  _  -1 )  -C— 

2  +  36  U  36  '  l-a 


=  0 


or 


rrf—  1  —  -2.  —  1  .»  1  J  ■  \  +  n  / .  1  +  1 

2  36  2  108'  M  2  3 


1  _  +  1  +  _2_ 

2  3  108 '  2  108 


=  0. 


Solving  for  a,  we  find 


a  = 

a  128  * 


b  = 


_  _22 


128 
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Then  from  (17  )  we  compute 


C 


2 


_5£2 

1317 


and 


as  we  should  expect. 


We  also  compute  that 


a(C2) 


“  1317  ^  1317 


so  that  our  statement  that  a(C  )  C  holds  for  the  entire  interval  is  verified. 
We  also  find  that 

a(C1J  =  1  -  C1 

so  the  dashed  curved  meets  the  hypotenuse  of  the  triangle  (see  Fig.  3  ) 
where  C  =  C^. 

We  can  compute  p  from  (12  )  using  for  arguments : 

A  -  a(C  ),  P2  =  1,  \  =  C. 

It  turns  out  that 

H-(C  )  =  (  2  +  36  128  ^  +  ^  "  36  128  ^  C* 


We  now  have  all  the  information  about  our  interval  except  the  optimizing 
Pj.  To  find  this  we  write  the  quantity  to  be  mini maxed  from  (12  )  (taking 

P2=  1): 


_  A±£.  _  JL 

2  36 


A  +  ( 


1 

2 


2Qg  X1-A  ) 


1  _  -JLjc 

3  108  '  ^  ' 


A  + 
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The  coefficient  of  A  is 


J_+P  „  1  _  _1  _  1  _  JL 

36  3  2  36  2  108  ' 


(18) 


If  this  coefficient  were  not  zero  the  maximizing  A  would  have  to  be  one  of 
its  extreme  values  and  not  a(c  ),  Thus  equating  (18  )  to  0  yields 


_  -11 
~  1 28  * 


Remark  i  Unlike  a  and  p, 
it  should  have  when  C  =  C^. 
that  then  all  values  of  P^ 


is  discontinuous  at  C^.  One  may  ask  what  value 
A  closer  scrutiny  of  our  analysis  informs  us 


in  the  interval 


To  -^-1 

U»128_ 


are  optimizing. 


The  next  interval  is  dealt  with  similarly.  We  assume  a  linear  form  for 

a(C  ).  However  the  straight  line  which  is  its  graph  soon  meets  the  line 

A  =  C  of  Fig.  3.  The  intersection  brings  the  interval  to  an  end. 

We  are  then  finished  as  far  as  p  Is  concerned,  for  0  is  constant  in 

the  region  IV  of  Fig.  3  and  above  the  dotted  curve  it  decreases  as  a  function 

* 

of  A.  Its  constant  value  in  IV  thus  produces  the  optimum  p„  Clearly  P^  =  1, 
=  0  are  optimal  here,  but  we  cannot  know  the  best  A  without  continuing 
the  computation  of  a.  Three  more  intervals  and  this  is  done. 

The  results  are  tabulated  below.  Fig.  4  is  a  plot  of  p  (or  £  );  Fig.  5 
repeats  Fig.  3  with  the  a  curve  in  final  form.  Fig.  6  represents  some  of 
the  less  simple  strategies.  For  the  sake  of  completeness  Figs.  7  and  8; 
which  depict  the  second  positionyare  included. 


This  statsnent  of  course  pends  some  simple  assumptions,  ,e . g 0 ,  that  the 
dotted  curve  does  not  enter  region  II  (See  Fig.  3  ),  but  these  are  easily 
disposed  of. 
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We  observe  the  p(C  )  is  increasing.  From  (10  )  we  conclude 


(?  (Sj  = 


(19  j 


We  also  infer  the  following  important  facet  of  the  optimum  strategies. 
Theorem  5:  The  optimizing  value  of  C  is  S„ 


This  means  that  when  E  is  two  units  from  P  he  should  always  move  away 
from  P.  Thus  to  express  E's  strategy  we  need  only  state  what  he  should  do 
when  one  space  from  P«  We  revert  to  the  terminology  if  the  proof  of  Lemma  1 
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and  concentrate  on  Q10  (hereafter  simply  Q ),  the  probability  that  E  remains 

immobile  when  adjacent  to  P.  Its  value  ascertained  from  (l J  and  (2  }  is 
* 

unique : 


and  it  is  plotted  in  Fig.  6.  The  curve  consists  of  segments  of  hyperbolas; 
the  left  part  is  abritrary  as  long  as  it  stays  in  the  (closed  )  shaded  region. 

It  remains  to  say  a  few  words  about  the  original  problem.  let  E  start 
his  flight  at  an  appreciable  distance  to,  say,  the  right  of  P.  We  have 
seen  that  his  best  policy  is  to  move  away  from  E  when  separated  by  two  spaces; 
then  a  fortiori  likewise  when  the  separation  is  more  than  two  spaces.  Thus 
when  the  players  are  more  than  two  spaces  apart  their  tactics  are  naively 
direct;  E  flees  and  P  pursues.  This  policy  favors  Pfs  information. 

At  any  time  the  signal  spots  E  at  one  of  three  points.  If  his  next  move 
is  certified  as  being  one  jump  to  the  right,  P  maintains  his  knowledge  of 
one  of  three  points.  The  next  signal  may  coincide  with  these  three  points; 
if  it  does  not,  E  is  spotted  to  within  one  or  two  points.  Thus,  as  the 
play  progresses,  this  sifting  continues  and  it  is  probable  that  E’s  position 
will  soon  be  known  to  P. 

Of  course  it  is  possible  for  E  to  deceive  P  by  adopting  less  inflexible 
tactics,  but  Theorem  5  (and,  if  true,  the  inference  drawn  from  it  above  ) 
shows  that  it  does  not  pay  him  to  do  so. 

It  appears  that  the  direct  phase  of  the  game  is  quite  simple. 

Glearly  it  must  always  lead  either  to  capture,  a  first,  or  a  second  position. 

If  the  initial  positions  were  widely  separated,  the  value  of  S  or  T  in  the 
latter  two  cases  will  probably  be  1;  if  not,  it  depends  on  the  probabilities 
of  P*s  location  at  starting. 

*  i.e„,  unique  in  terms  of  A.  In  Fig.  6  for  certain  C  (or  S  in  virtue  of (19  )), 
A  make  taka  any  value  which  the  ordinate  of  a  point  in  the  shaded  region. 


